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SCKE  OBSERVATIONS  ON  FACTOR  ANALYSIS 
Harry  H«  Haman 

While  ay  priaary  Intereate  in  factor  analyaia  have  been  concerned 
aith  the  developeent  of  Ita  aathodology,  I  vleh,  at  thia  tijae,  to  reodniace 
aoaewhat  about  the  origin  and  growth  of  the  aubject,  and  to  aake  an  appraiaal 
of  ita  present  statue.  This  paper,  therefore,  will  be  noDHaatheuatical, 
expoaitory  ii^  character. 

The  birth  of  factor  analyaia  ia  generally  aacribed  to  Charles  ^MNuraan. 
Hla  aonuaiantal  work  in  developing  a  psychological  theory  involving  a  single 
general  factor  and  a  nuaber  of  specific  factors  goes  back  to  1904  when  his 
paper,  ♦•General  Intelligence,  Objectively  Determined  and  Keaaured**,  was 
published  in  the  Ace ri can  Journal  of  Psychology.  Of  c<mrae,  his  1904 
investigation  was  only  the  beginning  of  hie  work  in  developing  the  Two- 
Factor  Theory,  and  this  early  work  is  not  ••explicitly  In  terms  of  factors**. 
Perhaps  a  more  crucial  article,  certainly  insofar  as  ths  statistical  aspects 
are  concerned,  ie  the  1901  paper  by  Karl  Pearson  in  which  he  sets  forth  '•ths 
sssthod  of  principal  axes'*.  Nsverthelsss,  ^marman,  who  devoted  the  remaining 
40  years  of  his  life  to  the  development  of  factor  analysis,  is  regarded  as 
the  father  of  the  subject. 

A  considerable  aaotmt  of  work  on  the  psychological  thsoriss  and 
mathematical  foundation#  of  factor  analysis  followed  in  the  next  twenty  yeare. 
The  principal  contributors  during  this  period  included  Charles  Spsansan, 

Cyril  Burt,  Karl  Pearson,  Godfrey  H.  Thomson,  J.  C.  Haxwell  Gamsit,  and 
Karl  Koltinger;  and  the  topics  reesiving  the  greatest  attention  were  ccmctmed 
with  the  proof  or  disproof  of  the  existence  of  general  ability,  the  study  of 
sampling  errors  of  tetrad  differences,  and  computational  methods  for  a  single 


-  2  - 


P-710 


g«iuir«l  factor  %ihlch  includod  the  fundamental  formula  «f  the  centroid  eolution. 

The  earljr  aodem  period  including  the  bulk  of  the  active  and  publiehed 
centroverey  on  factor  analyele«  came  after  1925,  with  a  real  spurt  of  activity 
in  the  1930*8.  ^  this  time  it  had  become  quite  apparent  that  Spearman*8 

Two-Pactor  Theory  was  not  alwa>a  adequate  to  describe  a  battery  of  tests. 

3o  group  factors  found  their  way  into  factor  analysis;  although  the  experimenters, 
at  firot,  were  very  reluctant  to  admit  such  deviation  from  the  basic  theory 
and  restricted  the  group  factors  to  as  maall  a  number  as  possible.  Vhat 
actually  happened  waa  that  the  theci^y  of  a  general  and  specific  factors  in 
Spearman’s  orig;inal  fom  was  st^rsedsd  by  theories  of  many  group  factors, 
but  the  early  method  continued  to  be  employed  to  determine  thee#  many  factors. 
Then  it  naturally  followed  that  tome  workers  sxplorsd  ths  possibility  of 
extracting  seversl  factors  dlrsctly  from  a  matrix  of  corrslatlons  among 
tssts,  and  thus  aross  ths  conespt  of  multipls-faetor  analysis  (Garrmtt,  1919 )• 

Uhils  ths  actual  term  may  be  due  to  Thurstone,  and  while  he  undoubtedly 
ham  done  most  to  popularise  the  method  of  multipls-fsctor  analysis,  hs  esrtalnly 
was  not  ths  first  to  talcs  except  ion  with  Spearsmn's  Two-Psctor  Theory  and  was 
net  ths  first  ta  dsrvalop  a  theory  of  many  factors.  It  is  not  even  ths  centroid 
■sthod  of  analysis  for  ^ioh  Thurstons  deserves  s  place  of  prominsncs  in 
factor  analysis.  The  centroid  method  is  clearly  admitted  by  Thurstons  to  be 
a  ccmpiitational  ccapromlse  for  ths  pri no ipal«f actor  solution.  Ths  truly 
rsMiricabls  ^ntribution  of  Thurstons  was  ths  gsnsralisation  of  Spearman’s 
tstrad«dlffsrsncs  criterion  to  ths  rsnk  of  the  eorrslation  matrix  as  ths 
basis  for  dstsimination  of  ths  number  of  common  factors.  He  saw  that  a 
sere  tstrad-dlffsrsncs  oorrespondsd  to  ths  vanishing  of  a  second-order 
dstaminant,  and  extended  this  notion  to  ths  vanishing  of  higher  order 
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dtt«mlruinta  as  tha  condition  for  acre  than  a  tingle  factor.  Th«  aatrix 
fonaulation  of  th«  probl«a  has  graatlj  i ^^ilitatad  furthar  advances  in  factor 
analysis. 

Lai  us  itirn  now  frxm  the  review  of  the  historical  devslopnents^  to 
consider  how  the  several  schools  of  ousdem  factor  analysis  arose  in 
peychology.  As  is  well  known,  a  given  aiatrlx  of  correlations  can  be  factored 
in  an  infinite  nuaber  of  different  ways.  (It  la  mot  entirely  clear  whether 
this  well  known  fact  was  truly  appreciated  in  the  earlier  days  of  factor 
analysis;  and  if,  in  fact,  the  failure  to  recognise  this  aathe>atical  truiaa 
aay  not  have  been  the  cause  of  the  laany  controversies  regarding  the  "true**, 
the  **beet*',  or  the  **invariant**  solution  for  a  set  of  data.)  When  an  infinite 
mmb4r  of  equally  accurate  solutions  are  available,  the  question  arises:  How 
shall  a  choice  be  aade  aBK>ng  these  poesibilities?  The  preferred  types  of 
factor  solutions  are  detsniined  on  the  basis  of  two  gsnsral  prlnciplss: 

(1)  statistical  sistplicity,  and  (2)  psychological  asaningfulnsss*  In  turn, 
each  of  theee  principle!  requires  interpretatiem,  and  each  has  besn  applied 
variously  to  yiald  several  distinct  schcwls  of  fsetor  analysts. 

If  one  were  to  nake  his  choice  entirely  upon  statistical  oonsideratiocis, 
a  rathsr  nstural  approach  would  be  to  represent  tbs  original  set  of  variables 
in  terns  of  a  nusiber  of  factors,  detemined  in  sequence  to  that  at  each 
eueoeseive  etage  the  factor  would  account  for  a  aaxijs\s&  of  the  variance* 

This  etatistically  optijoal  solution  —  the  method  of  principal  avee  — 
was  first  proposed  by  Pearson  at  the  turn  of  the  century,  and  in  the  1930*e, 
Hotelling  provided  the  full  developownt  of  the  method,  including  an  iterative 
process  for  the  deteralnstion  of  the  chaiactaristic  roots.  Whils  thi* 
procedure  is  perfectly  straightforward,  it  entails  a  very  considerable  amount 
of  computation,  and  beccews  impractical  with  ordinary  computing  facilities 
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tht  mtrix  is  of  erdsr  10  sr  gr«At«r*  In  rscsnt  howsvor^  this 

difficulty  hss  bssn  ovcrooMs  by  ih«  uss  of  hi^  apood  slsetronie  cos^:^«r8« 
Anothor  cholcs  basod  upon  statistioal  oonsiderations  is  ths  Csntroid 
Solution.  As  indioatsd  abOYS,  this  asthod  uas  introduead  only  as  a  casqputational 
sKpodisnt  uhan  it  bscaao  apparent  that  ths  principal  factor  solution  was  too 
laborious.  All  that  can  bs  said  for  ths  csntroid  astbod  is  that  it  produoss 
without  aueh  arlthnstie  oins  of  aaay  possibls  ssts  of  aaoss  iddeh  account  for 
ths  Yarlanes  in  a  aannsr  approaciaatlna  ths  optiaal  situation  of  ths  principal 
axss. 

Ths  sod  product  of  thsss  solLtions  —  principal  or  csntroid  —  is  not 
acosptabls  to  psyoholoflsts  (with  tbs  poasibls  szcoption  that  ths  principal 
factor  aolution  la  snastlasi  acosptabls  to  Burt).  In  qusiHt  of  **aaaningful** 

.  factor  solutionSf  psfoboloxlsta  havs  introduced  Ytrious  thsoriss  In  ths  bops 
of  arrlYlng  at  a  fem  of  solution  which  would  bs  unictus  and  apply  squally 

wall  to  intslli^es,  psrsonality^  physical  asasursasnts «  arid  any  othsr 

% 

Yarlablss  with  which  thsy  ai^ht  bs  oonesmsd.  Holsingsr*^  Bi-f actor  Thsory 
aad  TburstOM^s  Siapls  Structurs  Thsory  ars  in  this  olass.  On  ths  othsr 
handf  Thsasoc^s  Thsory  is  priaarlly  a  psyoholoaioal  thsory  of  ths 

wind.  Tbsrs  is  no  prsfsrrsd  tyi^  of  factor  solution  c^tainabls  uniqusly  on 
A^Minds  of  psycholacieal  siipiifieanes.  If  psyehologleal  osanlngfulnsss  ratbsr 
than  a  purs  statistical  standard  is  inpossd,  thsn  to  sens  sxtont  ths  JudpMnt 
of  ths  inrsitiipator  will  bs  involYsd.  Aitsspts  st  an  obJsetlYs  solution  to 
this  problss  will  bs  indioatsd  In  a  nsasnt.  Howsvsri  I  luds  no  attssipt  to  eorsr 
ths  voxic  of  d.  P.  Guilford^  RaTmoad  B«  Cattail^  John  Frsneh»  and  othsrs  con- 
osmsd  with  ths  study  and  iaolation  of  apseifie  psychological  factors. 

First.  I  wish  to  slaborats  on  ths  c{usstion  of  Indstsrainacy  in  factor 
analysis.  Ths  infinituds  of  factorisations  of  a  eorrslatlcn  natrix  aay 
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perhaps  betttr  b«  ccttpr«h«nded  froa  a  gsosaatric  lutarpratation  of  tho  «it\iatlon« 
W«  ciui  regard  th«  obsanrationa  on  a  aat  of  variablaa  aa  dat4irMining  a  nxa^r 
of  eaetora  (corraapendlng  to  the  variablaa)  in  a  apaca  aqual  to  the  nuabar 
of  aubjacta.  By  aathoda  of  factor  analyais  thaaa  vaetora  can  ganerally  ba 
contalnad  in  a  aptaca  of  aaallar  diitanaion  than  tha  nuaiibar  of  variablaa* 

Tha  coordinate  axes  of  thia  raducad  apaca  ara  tha  coMon  factors,  and  tha 
original  variablaa  can  ba  expreaaad  linaarly  in  tanaa  of  thass  factors* 

Tha  datarBlnation  of  thia  coanon-factor  apaca  ia  in  no  say  dapandant  on  tha 
particular  coordinata  fraaa  of  rafaranca  ae^loyad*  Thia  arbitrarinasa  ia 
raprasantad  gaooMtt'ically  by  tha  infinite  nuabar  of  rotations  poaaibla  fron 
one  sat  of  coordinata  axes  to  another* 

For  ease  of  oathaaatical  description,  and  sanatlaiaa  to  facilitate 
psychological  interpretation,  it  ia  cooaon  practice  to  change  tha  fraae  of 
rafaranca*  In  making  such  a  transformation  of  coordlnataa  it  nniat  ba  remembered 
that  the  geometric  configuration,  e«g*,  straight  line  or  eemni  of  points,  ia 
left  unaltered.  The  mathematical  expreaaion  or  formulas  describing  tbs 
gaomatric  configuration  may  change  under  transformation,  but  tha  configuration 
itself  is  invariant* 

Tha  sa thaaa tl clan  usually  is  concarMd  with  tha  gaomatrlc  configuration 
only,  using  tha  frame  of  rafaranca  aa  a  tool,  and  will  prefer  one  raferanc# 
ayetaa  to  another  if  it  yields  a  simpler  (and  more  elegant)  axpraaaion  for 
hla  configuration.  For  example,  tha  elaborate  formula  c<maiating  of  six 
terms: 


AX^^Br^4.CXT4.DX+KT-fF»0 

rapraaanta  a  geometric  configuration  (an  allipsa)  in  one  (arbitrary)  fraam 
of  rafaranca  while  tha  axpraaaion 
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iNipimsanit  prucifly  th«  mum  configurAtien  in  another  (arbitrary)  r«ftr«nc« 
friM  lalactad  no  at  to  oaka  tha  •qcjktion  aa  aii^ida  aa  poaalbla* 

UrJdka  tha  aathaMatieian«  iha  tpayeholoaiai  fraqoantly  eoneama  hijiaalf  idth 
tha  Intarpratatiof)  of  tha  frtJM  of  rafaranca,  uaing  tha  configuration  of 
pointa  aaraly  aa  tha  vehicle  to  gat  to  tha  particular  rafaranca  axea.  Thua« 
in  factor  analyaia  tha  gacaatrie  configuration  ia  a  auara  of  pointa «  each 
ona  rapraaanting  a  taat  and  tha  density  of  tha  points  bding  a  function  of 
tha  intarcorralations  SMong  tha  testa*  k  fraaa  of  rafaranca  aay  ba  aalaetad 
f'-r  psychological  intarpratation  on  tha  baais  of  tha  particular  configuration 
of  pointa  but  tha  aaphaaia  in  tha  resulting  psychological  theory  ia  on  tha 
coordinate  axaa,  not  tha  configxiratlon  alone. 

Tha  attaapt  to  fix  tha  coordinate  area  on  aoaa  objective  basis  has  bean 
undartakan  by  a  madbar  of  psychologists.  This  aork  was  spsarhsadad  by 
Thurstons  U  principla  of  **Siflpls  Structurs”«  and  hs  was  lusong  ths  first  to 
striva  for  an  oblactiva  dafiniiion  of  this  conespt  and  an  aoeoMpanylng  ob- 
Jactlva  procadurs  for  a  sljqplt  stnietura  solution*  Sines  1935 »  Thurstons 
has  baan  folloaad  by  Horst «  Tucksr,  Carroll,  Fsrgusan,  Saundsrs,  and  Wrlglsy 
with  spacifie  proposals  for  analytical  or  asBi-analytical  proeaduraa  for 
tha  attaimsant  of  aliapla  structura  or  approod^tiona  to  it*  Real  stridaa 
in  this  diractlon  hava  basn  Aids  vary  racantly,  and  raportad  in  tha  last 
two  years* 

In  gansral,  ths  rotation  of  axsa  in  ordor  to  arrivs  at  siApls  strueturs 
way  bs  viawad  as  an  attawpt  to  raduca  tha  cowplaxlty  of  tha  factorial 
daseription  of  tha  lasts*  Tha  ultiwata  objactiva  would  ba  a  uni-factor 
solution,  in  which  aach  tast  would  ba  of  eowplcxity  ona,  i*t«,  Inrolva  only 
s  aingla  oawwon  factor*  An  orthogonal  uni-factor  solution  is  axtrawsly 
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unlikely  with  empirical  data  ( except  for  the  liMiting  case  of  a  general 
factor  for  the  entire  battery  of  tests).  If  a  uni- factor  solution  wre  poaaible, 
the  variance  of  each  teat  would  result  froa  but  one  factor  loadings  and  a 
reasonable  aj^roach  to  this  ideal  would  saea  to  require  the  waxlata  imiquality 
in  the  distribution  of  the  variance  ai&ong  the  several  factors.  This  ii^lisi 
an  orthogonal  transformation  which  aaxij&isea  ths  variance  of  the  oontrlbutiona 
of  factor!  (i.s.,  the  squared  factor  loadings).  Basically^  then^  the  analytical 
approach  to  simple  structure  involves  the  aaxisdsation  of  fourth  powers  of 
factor  loadings.  For  this  reason,  Wrlgley  has  namsd  this  approach  ths 
'*Quartij«uc  Method. **  His  oethod  is  satheiiatically  equivalsnt  to  Carroll *s, 
although  the  two  procedures  were  developed  to  satisfy  diffsrent  criteria. 

Also,  Ferguson  and  Saundsrs  had  independently  arrived  at  very  sisiilar  reaulta. 
Since  a  naiac  has  been  appended  to  this  type  of  analytical  procedure,  it  is 
quits  Hksly  that  the  ssveral  indspendent  mathods  will  collectively  be  identified 
ae  the  '*QuartljMuc  Method.** 

In  addition  to  the  problea  of  obtaining  an  objective  rolution  which  would 
be  psychologically  acceptable,  factor  analysts  have  been  troubled  by  two 
I  aajor  weaknesses  —  one  in  theory  and  the  other  in  practice  —  being, 
respectively, 

1)  Lack  of  rigorous  teats  of  significance,  and 

2)  Ebccessive  coeqputational  requirements  • 

I  Lavley*s  work  on  ths  aaxiwun:  likelihood  cethod  during  the  past  15  years 

I  marks  the  beginning  of  a  period  wt^tich  we  hope  will  eventually  lead  to  a 
'  resolution  of  the  first  of  these  deficisncies.  The  second  area  of  difficulty 
is  being  resolved  by  the  advent  of  high  speed  electronic  eostputers.  Today, 
such  machines  as  the  Ordvac  at  Aberdeen,  the  I Iliac  at  the  University  of 
Illinois,  and  the  '/Jhlrlwind  at  MIT,  have  contributed  to  the  solution  of 
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problin*  in  factor  asial^is  in  fiva  distinct  ara&s: 

1)  Tha  rapid  oosiputation  of  corralation  coafflciants,  laaHng  th« 
tachniqusa  of  factor  analysis  faasibls. 

2)  Tbs  actual  cosqputation  of  factor  solutions  —  principal  axes  or 
■quara  root  solution  for  vary  larga  sMitricas. 

3)  Tha  astijMLtioa  of  cosmunalitias* 

4}  Analytic  approach  to  **siapla  struct\ira.** 

5)  Lawlay*s  saorl.rnjaa  likalihood  nathod,  and  significanca  tasts* 

It  is  safa  to  asoiaM  that  high  spaad  digital  coo^nttars  will  bacooia 
incraaaingly  availabla  for  factor  analysis  work.  Whila  innusarabla  advantagas 
will  isMsdiataly  accrua  to  tha  aciantist,  thara  ara  also  dangars  in  tha  graatar 
aaaa  of  coAputations.  Ha  will  not  hava  such  intiaata  knowladga  of  his  data 
as  in  tha  caaa  of  a  parson  who  apands  considarabla  tiM  on  a  dask  calculator. 
Tha  aaaa  with  which  coaputations  can  ba  acconplishad  in  this  alactronic 
aga  aay  load  to  axcassas  and  wastad  af fort.  Howavar,  tha  tiltiaata  affact 
of  tha  high  spaad  computars  mky  bast  ba  daacribad  in  Wriglay*s  words: 

”«..(thay)  ara  going  to  play  ouch  tha  sasta  role  for  the  s tails ticallyHsindad 
psychologist  as  tha  talascopa  has  for  ^ha  astronoiaar,  and  tha  microseopa  for 
tha  biologist  tha  rola  of  an  instnuBant  which  leads  to  greatly  widened 
horisons.** 


